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information can also include 
an address from which 
additional information about 

the device and upgrades are automatically obtained. This address is either an internet address or points to a location within a network of 
devices. The address can also be modifiable. Alternatively, the self-describing information also includes driving software for enhancing 
the graphical user interface and controlling the operation of the device through another system. This driving software is written either in 
the native language of the device on which it is uploaded and executed or in a platform neutral language such as Java™. The graphical 
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A METHOD AND APPARATUS FOR INCLUDING 
SELF-DESCRIBING INFORMATION WITHIN DEVICES 

RELATED APPLICATIONS : 

5 This application claims priority under 35 U.S.C. § 119(e) of the co-pending U.S. 

provisional application Serial Number 60/054,327 filed on July 31, 1997 and entitled "A 
METHOD AND APPARATUS FOR INCLUDING SELF-DESCRIBING INFORMATION 
WITHIN DEVICES." The provisional application Serial Number 60/054,327 filed on July 
3 K 1997 and entitled "A METHOD AND APPARATUS FOR INCLUDING SELF- 

10 DESCRIBING INFORMATION WITHIN DEVICES" is also hereby incorporated by 
reference. 

FIELD OF THE INVENTION : 

The present invention relates to the field of including self-describing information 
15 within a device. More particularly, the present invention relates to the field of including 
information within a device describing the physical attributes, features, capabilities and 
operation of the device. 

BACKGROUND OF THE INVENTION : 

20 The IEEE 1394-1995 standard, "1394-1995 Standard For A High Performance 

Serial Bus," is an international standard for implementing an inexpensive high-speed serial 
bus architecture which supports both asynchronous and isochronous format data transfers. 
Isochronous data transfers are real-time transfers which take place such that the time 
intervals between significant instances have the same duration at both the transmitting and 

25 receiving applications. Each packet of data transferred isochronously is transferred in its 

own time period. An example of an ideal application for the transfer of data isochronously 
would be from a video recorder to a television set. The video recorder records images and 
sounds and saves the data in discrete chunks or packets. The video recorder then transfers 
each packet, representing the image and sound recorded over a limited time period, during 

30 that time period, for display by the television set. The IEEE 1394-1995 standard bus 

architecture provides multiple channels for isochronous data transfer between applications. 
A six bit channel number is broadcast with the data to ensure reception by the appropriate 
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application. This allows multiple applications to simultaneously transmit isochronous data 
across the bus structure. Asynchronous transfers are traditional data transfer operations 
which take place as soon as possible and transfer an amount of data from a source to a 
destination. 

5 The IEEE 1394-1995 standard provides a high-speed serial bus for interconnecting 

digital devices thereby providing a universal I/O connection. The IEEE 1394-1995 
standard defines a digital interface for the applications thereby eliminating the need for an 
application to convert digital data to analog data before it is transmitted across the bus. 
Correspondingly, a receiving application will receive digital data from the bus, not analog 

10 data, and will therefore not be required to convert analog data to digital data. The cable 
required by the IEEE 1394-1995 standard is very thin compared to other bulkier cables 
used to connect such devices. A node on the IEEE 1394-1995 serial bus is considered a 
logical entity with a unique address on the bus structure. Each node provides an 
identification ROM, a standardized set of control registers and its own address space. 

15 The IEEE 1394-1995 serial bus provides plug and play capabilities for applications. 

Devices can be added and removed from an IEEE 1394-1995 bus while the bus is active. 
If a device is so added or removed the bus will then automatically reconfigure itself for 
transmitting data between the existing nodes. To control any of these devices, the user 
must manually operate each device separately through controls on the device. In the 

20 alternative, it is well known that infrared control devices exist for a variety of home 

entertainment type products such as television. VCR. and sound systems. There are even a 
number of so-called 'universal remote' products available that can control a number of 
different brands or types of equipment. 

If a computer system is connected as one of the nodes within the network, then 

25 particular devices connected to the network may be controlled through the computer 

system. The computer system runs driving software specific to the particular device which 
provides an interface to the user and allows the user to control and operate the device 
through the computer system. This driving software is typically packaged with the device 
and included on a floppy disk or CD-Rom. The driving software is then loaded into the 

30 computer system by the user as part of the initialization procedure when the device is first 
connected to the network or to the computer system directly. For example, when a printer 
is first connected to a computer system, a user must load the printer driver software on the 
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computer system before the computer system is able to recognize and communicate with 
the printer. After the printer driver software is loaded on the computer system, the user 
has the ability to control the operation of the printer through commands entered into the 
computer system. If the printer driver software is later updated, the user must obtain the 
5 software upgrade, again on a floppy disk or CD-Rom, and load it into the computer 

system. For devices configured for operation with computer systems of different platforms, 
such as MAC or PC based platforms, multiple disks, each including the driving software 
and capable of being loaded into one of the available platforms, must be included with the 
device. 

10 For many multimedia devices, such as camcorders and compact disk players, which 

may be connected to a computer system through an IEEE 1394-1995 network, such driver 
software is typically not available. While these devices may be able to communicate with 
the computer system, their control is effected through the device itself. Currently, a user is 
unable to control the operation of such a device through the computer system. However, 

15 as new applications for such devices are created, driving software may become critical to 
the successful operation of the device within a specific application. 

Devices are also connected together or to a network without a computer system 
available within the configuration. In such a network or configuration, it is very likely that 
there is no device capable of running driving software for controlling the operation of other 

20 devices within the network. An example of such a network is a configuration including a 
television and a VCR, connected to each other. The user currently programs the VCR, in 
such a configuration, through text-based menus driven by the VCR and displayed on the 
television. To enter commands related to this programming operation, the user utilizes 
either the front panel of the VCR or a remote control device which sends transmissions to 

25 the VCR. There is currently no manner to control the operation of the VCR through the 
television. Current IEEE 1394-1995 technology also lacks a method to reliably determine 
characteristics of a device at a specific node, including the type of device, its features and 
capabilities and user interface information for representing the device and its features to the 
user. 

30 What is needed is a method for storing information within a device, about that 

device, which can then be transmitted to other devices, either through a direct connection 
or through a network. What is further needed is a method for retrieving such self- 
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describing information from a device or from information provided by the device. What is 
also needed is a method for automatically obtaining information and driving software from 
a device or from information provided by the device, thereby eliminating the necessity of 
including one or more disks containing the driving software with the device. 

5 

SUMMARY OF THE INVENTION : 

Self-describing information is included within a device and contains information 
relating to a graphical representation of the device, the controls available on the device and 
the interface required to access those controls. The self-describing information is 

10 preferably embedded within a ROM within the device and is read by other devices coupled 
to the device for presenting a graphical user interface through which the device can be 
remotely controlled by a user. The self-describing information can also include an address 
from which additional information about the device and upgrades are automatically 
obtained. This address is either an internet address or points to a location within a network 

15 of devices. The address can also be modifiable. Alternatively, the self-describing 

information also includes driving software for enhancing the graphical user interface and 
controlling the operation of the device through another system. This driving software is 
written either in the native language of the device on which it is uploaded and executed or 
in a platform neutral language such as Java™. The graphical user interface is presented on 

20 a television, computer or other appropriate system for controlling multiple devices through 
the system. The controlling system obtains the self-describing information from each 
device within the configuration. The graphical user interface includes a graphical 
representation of the devices and specific control features available to the user presented in 
a graphical orientation. Alternatively, a three-dimensional representation of the device is 

25 presented with controls represented on the device. If no controlling system is available, a 
graphical user interface is controlled by an application within the device and presented on 
an available display. 
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BRIEF DESCRIPTION OF THE DRAWINGS : 

Figure 1 illustrates a network configuration including a video camera, a video 
cassette recorder, a computer system and a television coupled together by the input/output 
(I/O) busses. 

Figure 2 illustrates a block diagram of relevant components within the video camera 
of Figure 1 . 

Figure 3 illustrates a memory map of the read-only memory of the preferred 
embodiment of the present invention, including self-describing information. 

Figure 4 illustrates a memory map of a read-only memory of an alternate 
embodiment of the present invention. 

Figure 5 illustrates an exemplary configuration window' of the graphical user 
interface of the present invention. 

Figure 6 illustrates a stream window including two subpanes presented within the 
graphical user interface of the present invention. 

Figure 7 illustrates an example of a stream window with a video camera as a source 
device and a video cassette recorder as a sink device. 

Figure 8 illustrates an example of a stream window having a source device and 
multiple sink devices. 

Figure 9 illustrates an alternate subpane to be displayed within the stream window. 

Figure 10 illustrates an exemplary computer system on which the graphical user 
interface of the present invention is implemented. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT : 

A device according to the present invention includes self-describing information 
embedded within the device which preferably contains information about the device, 
including information which can be used to generate a graphical representation of the 
device for use with a graphical user interface. The self-describing information also 
includes an internet address from which additional information about the device, its 
features, functions and controls is obtained. Alternatively, the self-describing information 
also includes driving software for enhancing the graphical user interface and controlling the 
operation of the device. 
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The graphical user interface is preferably presented on a television, if one is 
available within the network. Other display systems can be used such as a computer or 
other media device with an accompanying display. Through the graphical user interface, a 
user is able to control operation of the devices coupled within the network. The graphical 
5 user interface presents the user with information and status of the devices, as well as 

allowing the user to configure collections of devices for transmitting streams of data and 
completing tasks. 

Preferably, the self-describing information is embedded in a read-only memory 
(ROM) within each device. Other devices coupled to a device, either directly or through a 

10 network, are then able to obtain the self-describing information from that device by a read 
operation of the device's ROM in order to provide an enhanced user interface through 
which the user can more easily and efficiently control the operation of the devices within 
the network. Alternatively, the self-describing information is stored within any other 
appropriate memory circuit or component within the device, such as tape memory, 

15 magnetic or optical disc memory and flash memory. In a further alternate embodiment, the 
self-describing information is stored on a media device such as a digital video disk, a video 
tape, a compact disc and a mini-disc or received through a receiver of a broadcast from a 
satellite. 

In a situation where the device is coupled to another device with a microprocessor 
20 and a display, such as a computer system, television with a microprocessor or a settop box 
in combination with a television, the computer system obtains the self-describing 
information from the device and provides a graphical user interface on the display through 
which a user is able to control the device. This graphical user interface includes a 
graphical representation of the device and the specific control features available to the user. 
25 Through the graphical user interface the user is able to control the device through the 

computer system, allowing the user to control the operation of multiple devices through a 
single computer system. Throughout this document, the term computer system will be used 
to refer to any digital control device including a microprocessor and a display. While a 
television with an internal microprocessor and a settop box in combination with a television 
30 are two examples of such systems, it will be apparent that there are other general purpose 
or special purpose computer systems available. 
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The application software necessary to present the graphical user interface is 
preferably loaded onto and resident within the controlling device. In the preferred 
embodiment of the present invention, the self-describing information received from the 
device must be in a format understood by the application software in order to present the 
5 graphical user interface and send control instructions to the device. The application 

software provides a graphical user interface, as will be discussed below, which presents the 
graphical representation of the device and the controls available to the user. This graphical 
user interface is adaptable to many different types of devices. In an alternate embodiment, 
the application software is obtained by the computer system from the ROM within the 
10 device itself. The self-describing information also includes an internet address from which 
the computer system can automatically obtain additional or duplicate information about the 
device or even software for presenting an enhanced graphical user interface for controlling 
the device. In a further alternate embodiment, the self-describing information also includes 
an operating system driver for one of the most common operating systems, including 
15 Windows 95 ®. Macintosh ® and Aperios™. The driving software is written either in the 
native language of the device on which it is uploaded and executed or in a platform neutral 
language such as Java™. 

When a device is coupled in a configuration without a computer system, the self- 
describing information and other software available within the device will be used to 
20 present a graphical user interface to the user. This graphical user interface will be 

presented on whatever display is available to the device within the configuration. Through 
this graphical user interface, the user is then able to control the operation of the device. If 
no display is available within the configuration, the user will then be left to manually 
control the device without the aid of a graphical user interface. 
25 An exemplary network configuration including a video camera 1 0, a video cassette 

recorder 14, a computer system 18 and a television 19 coupled together by the input/output 
(I/O) busses 12. 16 and 17, is illustrated in Figure 1. The I/O bus 12 couples the video 
camera 10 to the video cassette recorder 14, allowing the video camera 10 to send data to 
the video cassette recorder 14 for recording. Through the I/O bus 12, the video cassette 
30 recorder 14 is also able to send communications to the video camera 10. The I/O bus 16 
couples the video cassette recorder 14 to the computer system 18, allowing the video 
cassette recorder 14 to send data to the computer system 18 for display and allowing the 

- 7 - 



BNSDOCID: <WO 9906910A1_L> 



WO 99/06910 



PCIYUS98/15529 



computer system 18 to send communications to the video cassette recorder 14. Through 
the I/O busses 12 and 16 ? the computer system 18 is also able to send and receive 
communications from the video camera 10. The I/O bus 17 couples the video cassette 
recorder 14 to the television 19 allowing the video cassette recorder 14 to send data to the 
5 television 19 for display. Through the I/O busses 12 and 17, the television 19 is also able 
to send communications to and receive communications from the video camera 10. 
Preferably, the I/O busses 12, 16 and 17 are IEEE 1394-1995 serial busses. It should 
however be apparent to those skilled in the art that any other appropriate bus or network 
configuration may be used to couple the devices together. 
10 A block diagram of relevant components within the video camera 10 is illustrated in 

Figure 2. A bus interface circuit 24 for interfacing the device 10 to the I/O bus 12 and 
controlling the communications over the I/O bus 12 is coupled to a controller circuit 22. 
The controller circuit 22 controls the operation of the device 10 and the components 
included within the device. A ROM 20 for storing the self-describing information of the 
15 present invention and necessary instructional code is coupled to the controller 22. It should 
be apparent that the device 10 includes additional components not shown within Figure 2. 
It also should be apparent that other devices including the self-describing information are 
similarly configured in this regard. 

The ROM 20 includes the self-describing information about the device 10. A 
20 memory map of the ROM 20. including self-describing information, within the preferred 
embodiment of the present invention, is illustrated in Figure 3. The ROM 20 includes a 
section 25 containing information about the device, a section 26 containing information 
regarding the graphical representation of the device, a section 28 containing information 
regarding control descriptors and a section 30 containing information regarding 
25 functionality descriptors. The device image section 26 of the ROM 20 includes data for 
forming a graphical representation of the device. In order that this data can be read and 
understood by a variety of devices, the data is preferably stored in a standard format. In 
the preferred embodiment, the data representing the graphical representation of the device 
is stored in the portable network graphics (PNG)- format. The device information section 
30 25 includes information about the device including the manufacturer, the model number 
and the type of device. 
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The graphical representation of the device stored within the ROM 20 is preferably a 
256 color representation, in order to fully represent the device and allow the graphical 
representation to be readily adapted to different types of environments. Alternatively, in 
order to conserve space within the ROM 20. less colors can be used to graphically 

5 represent the device 10. As known to those skilled in the art, the more colors used to 

represent the device 10, the greater the minimum bit-depth necessary for the image and the 
greater the storage space required within the ROM 20. Accordingly, available storage 
space within the ROM may be a consideration as to the detail of the graphical 
representation stored within the self-describing information. As is well known to those 

10 skilled in the art, it is also possible to encode and store graphics information in higher bit 
depths, such as 16, 24 or 32 bits. In an alternate embodiment, the graphical representation 
includes additional information such as transparency and color conversion information. 

The control descriptor section 28 includes a description of each available physical 
button or control included on the device 10. Within the control descriptor section 28. there 

15 is preferably a description of each physical button or other control on the device 10, 

including localized text which provides a name for the control feature represented, the type 
of control and the location of the control on the device 10. The type of control 
information refers to whether the control is discrete or continuous and includes other 
descriptive information about the control, such as the range of allowable inputs. The 

20 location of the control is represented as a rectangle within the overall device image 

rectangle which describes the relative position of the control on the device 10. In this 
embodiment, this control information serves to describe the type of functionality 
represented by the physical features of the device 10. This information is then used by the 
computer system 1 8 or another device to generate a graphical user interface through which 

25 the user can control the operation of the device. As will be described in detail below, the 
graphical user interface of the preferred embodiment does not include the controls on the 
graphical representation of the device, but instead includes them in a block of available 
controls. Alternatively, the available controls are presented on the graphical representation 
of the device for selection by the user. 

30 The functionality descriptor section 30 includes information which provides access 

to the control interface used by the device 10. The functionality descriptor information 
provides the information necessary for the computer system 18 or another device to invoke 
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BNSOOCID: <WO 9906910A1 J_> 



WO 99/06910 



PCT/US98/15529 



the appropriate commands for controlling the operation of the device 1 0 with the available 
controls. 

In an alternate embodiment of the present invention, the control and functionality 
descriptor sections are combined within the same section in the ROM 20. This allows each 

5 control and its associated functionality to be accessed together within the same physical 
space within the ROM 20. 

A memory map of a ROM 40 of an alternate embodiment of the present invention 
is illustrated in Figure 4. The ROM 40 includes information for presenting a three- 
dimensional graphical representation of the device 10. The ROM 40 includes a device 

10 information section 41. The ROM 40 includes a section 42 containing information 
regarding the graphical representation from the front of the device and a section 44 
containing control and functionality descriptors relating to controls present when the device 
is viewed from the front. The ROM 40 also includes a section 46 containing information 
regarding the graphical representation from the top of the device and a section 48 

15 containing control and functionality descriptors relating to controls present when the device 
is viewed from the top. The ROM 40 further includes a section 50 containing information 
regarding the graphical representation from the back of the device and a section 52 
containing control and functionality descriptors relating to controls present when the device 
is viewed from the back. Again, this information is then used by the computer system 18 

20 or another device to generate a three-dimensional graphical user interface through which 
the user can control the operation of the device. As should be apparent, device images 
from other sides of the device may be included as appropriate, depending on the device and 
the placement of the available controls. 

Presenting a three-dimensional graphical representation of the device 10 in this 

25 manner provides a user with a graphical representation of the controls which are otherwise 
available to the user manually. In this manner, devices with controls on or behind fold- 
down panels can be graphically represented to correspond to the actual appearance of the 
device and allow the user to control the operation of the device graphically through another 
device or system as they would otherwise control the device manually. 

30 The specific graphical user interface presented to the user depends on the types of 

other devices available to the device 10, through the network. For example, if the video 
camera 10 is coupled to a network including the computer system 18, as illustrated in 
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Figure 1 , then a more elaborate graphical user interface for controlling the video camera 1 0 
should be presented to the user by the computer system 18. If the video camera 10 
however is coupled to a network which includes only the television 19, but not the 
computer system 18, then a less elaborate graphical user interface will be appropriate 
5 because this graphical user interface will be driven by the video camera itself and not the 
television 19, unless the television 19 includes an internal microprocessor or is coupled to a 
settop box. 

In order to allow the devices including self-describing information of the present 
invention to be readily adaptable to many different configurations, the ROM 20 of the 

10 preferred embodiment also includes a section 32 containing an internet address. This 

internet address is used by the computer system to obtain information about the device 10. 
as necessary for presenting a more elaborate graphical user interface to the user. As should 
be apparent, the computer system 1 8 must include a modem in order to access the 
information at the internet address. Using the internet address, the computer system 1 8 

15 automatically obtains more detailed or additional information about the device 10. Such 
access of the internet address is preferably transparent to the user and is performed after 
initialization of the device 10 to the network. Through this internet address, the computer 
system 18 is able to obtain driving software for controlling the operation of the device 10, 
thereby eliminating the need to include a disk with the device. Also through this internet 

20 address, the computer system 18 can later automatically obtain upgrades to the self- 
describing information or driving software, allowing devices to be later used in applications 
not available when the device was first designed. In an alternate embodiment of the 
present invention, only the internet address is included within the device and the self- 
describing information is automatically obtained by a controlling device after reading the 

25 internet address from a target device. This embodiment minimizes the required storage 
space required within the device. Depending upon the amount of memory available, it is 
also possible to include user instructions or 'help' information in the ROM 20. 

The memory map of the ROM 20 illustrated in Figure 3 is preferred because it 
provides high capability for presenting a graphical user interface while minimizing 

30 overhead and the data is always readily available to a controlling device. The ROM 20 

within the device 10 includes a limited amount of memory space which is also utilized for 
other operational code and data required by the controller 22. In order to minimize the 
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amount of the ROM 20 required for storing the self-describing information of the present 
invention, the ROM 20 includes the information within the sections 25, 26, 28 and 30, as 
described above, for presenting a graphical user interface to the user. The internet address 
in the section 32 is provided for those configurations for which more information is 

5 appropriate. Such systems will typically have memory space available, on which the 

information received from the internet address is loaded. Therefore, through the internet 
address, a controlling device, such as the television 19, is able to obtain the additional 
information for providing enhanced functionality for controlling a target device 10, such as 
the video camera 10. In an alternate embodiment, the ROM includes only the internet 

10 address and a controlling device must rely on the internet to obtain the self-describing 

information for the target device. In a further alternate embodiment, the ROM includes a 
uniform resource locator (URL) address from which the self-describing information for the 
target device is obtained. This URL address can point to an internet address, to a location 
in the local audio/video network or to a location within the target device itself. This URL 

15 address can point to a memory storage location such as a hard disk drive, either in the local 
audio/video network or within the target device, which contains the self-describing 
information. In still a further alternate embodiment, this URL address is modifiable, 
allowing a user to download self-describing information, as discussed herein, and store that 
information on a hard disk drive, for example. The URL for the target device can then be 

20 modified to point to this hard disk file to obtain the self-describing information for the 
device. 

An exemplary configuration window which is constructed using the preferred 
embodiment of the present invention is illustrated in Figure 5. This configuration window 
62 is displayed on the computer system 18 and provides to a user a graphical representation 

25 representing the devices within a configuration. It should be apparent that this graphical 

user interface can be displayed on any other appropriate device within the network, through 
which the user is able to control the other devices. In the configuration window 62. the 
devices and connections of the configuration illustrated in Figure 1 are represented. 
Specifically, a graphical representation 60 of the video camera 10 is shown coupled to a 

30 graphical representation 64 of the video cassette recorder 14. The graphical representation 
64 of the video cassette recorder 14 is shown coupled to a graphical representation 68 of 
the computer system 18 and a graphical representation 69 of the television 19. 
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The configuration window 62 provides a collection of icons representing the devices 
available within the network and a representation of the actual topology of the device 
connections. The icons are the graphical representations obtained by the computer system 
1 8 from the ROM 20 within each device. Preferably, the location of the devices within the 
5 window is determined by the computer system 1 8 in order to minimize crossed lines. The 
device connections are preferably determined utilizing a media manager as taught in U.S. 

Patent Application Serial No. , filed on May 8, 1998, and entitled "Media Manager 

For Controlling Autonomous Media Devices Within A Network Environment And 
Managing The Flow And Format Of Data Between The Devices," which is hereby 
10 incorporated by reference. Alternatively, the device connections are determined by directly 
examining the IEEE 1394-1995 serial bus. 

Within the configuration window 62, a user is able to obtain detailed information 
about the device by selecting the graphical representation or icon of the device. This 
detailed information includes information obtained from the self-describing information 
15 stored within the device's ROM 20, including device specific data. The detailed 
information also includes the current status of the device. 

Within the graphical user interface, a stream window, as illustrated in Figure 6, is 
used to provide available controls and facilitate the completion of an application or task. 
The stream window 70 includes two subpanes 72 and 74. The first subpane 72 includes a 
20 "Start" control button 76. The second subpane 74 includes a "Ready" control button 78. 

When operation of devices within the network is desired, a source device, from which data 
is to be transmitted, is placed within the first subpane 72, by selecting the device in the 
configuration window 60 and dragging it to the first subpane 72. One or more sink 
devices, to which the data from the source device is to be sent, are then placed within the 
25 second subpane 74 in the same manner. As will be described below, when more than one 
sink device is included within a stream window, each sink device will preferably be 
included in a separate sub-pane. 

An example of a stream window with a video camera as a source device and a 
video cassette recorder as a sink device is illustrated in Figure 7. Within the first subpane 
30 72, the graphical representation 80 of the video camera is displayed after being selected 
and moved from the configuration window 60. Once the graphical representation 80 is 
moved into the first subpane 72, the available control functions 81, obtained from the self- 
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describing data within the ROM 20 of the video camera 10, are also displayed within the 
first subpane 72. Within the second subpane 74, the graphical representation 84 of the 
video cassette recorder is displayed after being selected and moved from the configuration 
window 60. Once the graphical representation 84 is moved into the second subpane 74, 
5 the available control functions 85, obtained from the self-describing data within the ROM 
of the video cassette recorder 14, are displayed within the second subpane 74. 

From the stream window 70, displayed on the computer system 1 8. a user is able to 
control the operation of the video camera 10 and the video cassette recorder 14 for the 
application of sending a stream of video and audio data from the video camera 10 to the 
10 video cassette recorder 14, The controlling device sends the necessary commands in order 
to activate the target device(s) and complete the appropriate task(s). When the user is then 
ready to send the stream of data, the appropriate controls 81 are activated within the source 
subpane, in this case the play button, and then the "Start" control button 76 is activated. 
When the "Start" control button 76 is activated, the computer system 18 instructs the video 
15 camera 10 to begin sending the stream of data to the video cassette recorder 14. If 

necessary, commands are sent from the controlling device to the video camera 10 in order 
to turn the power to the video camera 10 on and put the video camera 10 into a play mode. 
The video cassette recorder 14 will record the stream of data from the video camera 10 
once the appropriate controls 85 are activated within the sink subpane, in this case the 
20 record button, and the "Ready" control button 78 is activated. When the "Ready" control 
button 78 is activated, the computer system 18 instructs the video cassette recorder 14 to 
begin recording the stream of data from the video camera 10. If necessary, commands are 
sent from the controlling device to the video cassette recorder 14 in order to turn the power 
to the video cassette recorder 14 on and put the video cassette recorder 14 into a record 
25 mode. Until the controls are then deactivated, the video cassette recorder 14 will record 
the stream of data sent from the video camera 10. In order to complete this task, the 
computer system 18 initializes an appropriate channel on the IEEE 1394-1995 serial bus 
and controls the flow of the data over the IEEE 1394-1995 serial bus. 

Additional sink devices are added to the stream window 70 by selecting the 
30 appropriate graphical representation of the desired device and moving it to the stream 
window 70. When graphical representations of additional devices are moved into the 
stream window 70, those devices automatically become sink devices to receive the data 
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stream from the source device. An example of a stream window having a source device 
and multiple sink devices is illustrated in Figure 8. The stream window 70 of Figure 8 
includes the first and second subpanes 72 and 74 of the stream window of Figure 7, as 
discussed above. In addition, the stream window of Figure 8 includes a third subpane 86. 

5 Within the third subpane 86, the graphical representation 89, representing the television 19. 
is displayed after being selected and moved from the configuration window 60. Once the 
graphical representation 89 is moved into the third subpane 86, the available control 
functions 90 of the television, which are obtained by the computer system 18 from the self- 
describing data within the ROM in the television 19 ? are displayed within the third subpane 

10 86. The third subpane 86 also includes a "Ready" control button 88. In this stream, the 
television 19 will display the stream of data being transmitted from the video camera 10, 
once the appropriate controls are activated within the sink subpane, in this case the play 
button, and the "Ready" control button 88 is activated. When the "Ready" control button 
88 is activated, the computer system 18 instructs the television 19 to begin displaying the 

15 stream of data from the video camera 10. If necessary, the controlling device will also 
send commands to ensure that the power to the television 19 is turned on and that the 
television 19 is on the appropriate channel to display the video stream sent from the video 
camera 10. Until the controls are then deactivated, the video cassette recorder 14 will 
record and the television 19 will display the stream of data from the video camera 10. 

20 An alternate subpane to be displayed within the stream window is illustrated in 

Figure 9. The subpane 100 includes the graphical representation of a video cassette 
recorder 104 r the available controls 108 and the "Ready" control button 110. In addition, 
the subpane 100 also includes a status area 106 for displaying to the user a status of the 
video cassette recorder. In this example, the status area 106 displays a counter representing 

25 a count from a particular point on the video tape within the video cassette recorder. The 
status area 106 is initialized from the self-describing data stored within the ROM of the 
video cassette recorder 14. The status area is then updated by communications between the 
video cassette recorder 14 and the computer system 18. In the example illustrated in 
Figure 9, the counter is updated by signals sent from the video cassette recorder 14 to the 

30 computer system 18 during the flow of the stream of data from the video camera 10 to the 
video cassette recorder 14. 
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In an alternate embodiment of the graphical user interface of the present invention, 
used in conjunction with the ROM 40 illustrated in Figure 4, the graphical representations 
of the devices within the configuration are three-dimensional. Also, the available controls 
are displayed directly on the graphical representation of the device, rather than below the 
5 graphical representation of the device. In a further alternate embodiment of the present 
invention, the self-describing information is used to provide a graphical user interface as 
taught in U.S. Patent Application No. 08/747,452, entitled "Graphical User Interface 
Including Graphical Representation Of Devices Coupled To IEEE 1394-1995 Serial Bus 
And Flow Of Data Between Applications" and filed on November 12, 1996, which is 
10 hereby incorporated by reference. 

While the graphical user interface of the present invention may advantageously be 
implemented on nearly any conventional computer system or other system under processor 
control, an exemplary computer system 400 on which the graphical user interface of the 
present invention is implemented is illustrated in Figure 10. In Figure 10, the computer 
15 system 400 includes a central processor unit (CPU) 40L a main memory 402, a video 

memory 403, a keyboard 404 for user input, supplemented by a conventional mouse 405 
for manipulating graphic images as a cursor control device and a mass storage device 406. 
all coupled together by a conventional bidirectional system bus 407. The mass storage 
device 406 may include both fixed and removable media using any one or more of 
20 magnetic, optical or magneto-optical storage technology or any other available mass storage 
technology. The system bus 407 contains an address bus for addressing any portion of the 
memory 402 and 403. The system bus 407 also includes a data bus for transferring data 
between and among the CPU 401, the main memory 402, the video memory 403 and the 
mass storage device 406. 
25 A video multiplex and shifter circuit 408 is coupled to a port of the video memory 

403 and to a video amplifier 409. The video amplifier 409 drives a monitor or display 410 
on which the graphical user interface of the present invention is displayed. The video 
multiplex and shifter circuitry 408 and the video amplifier 409 convert pixel data stored in 
the video memory 403 to raster signals suitable for use by the monitor 410. 
30 The self-describing information included within a device and the graphical user 

interface of the present invention allow a user to control the operation of devices preferably 
coupled together by an IEEE 1394-1995 serial bus network. The graphical user interface 
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incorporates the self-describing information from devices within the network, presenting to 
the user a graphical representation of the devices and their available controls. It should be 
apparent that the graphical user interface of the present invention can also be used to 
control devices coupled together in other types of networks and configurations. It should 

5 be apparent that many other types of graphical user interfaces could be generated using the 
self-describing information. It should also be apparent that the self-describing information 
can be used for other types of applications and in other environments than those described 
and illustrated. The self-describing information of the present invention is preferably used 
to provide a graphically oriented interface through which a user has the ability to control 

10 one or more devices through a single device or system. This graphically oriented interface 
includes graphical representations of the devices and available controls. An internet 
address is also provided within the self-describing information to allow the system through 
which the interface is provided to obtain additional information about the device or 
software for driving the device. 

1 5 The present invention has been described in terms of specific embodiments 

incorporating details to facilitate the understanding of principles of construction and 
operation of the invention. Such reference herein to specific embodiments and details 
thereof is not intended to limit the scope of the claims appended hereto. It will be 
apparent to those skilled in the art that modifications may be made in the embodiment 

20 chosen for illustration without departing from the spirit and scope of the invention. 
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CLAIMS 

We Claim: 

11. A method of interfacing between devices comprising the steps of: 

2 a. embedding self-describing information within a first device; and 

3 b. configuring the first device to allow a second device to access the self- 

4 describing information for interfacing with the first device. 

1 2. The method as claimed in claim 1 wherein the self-describing information 

2 includes a graphical representation of the first device. 

1 3. The method as claimed in claim 2 wherein the self-describing information 

2 further includes information regarding controls and functionality of the first device. 

1 4. The method as claimed in claim 3 wherein the self-describing information 

2 includes an address from where additional information about the first device is obtained. 

1 5. The method as claimed in claim 4 further comprising the step of providing 

2 an interface on the second device using the self-describing information, wherein a user has 

3 the ability to control operation of the first device through the interface. 

1 6. The method as claimed in claim 5 wherein the interface includes the 

2 graphical representation of the device and available controls. 

1 7. The method as claimed in claim 6 wherein the self-describing information 

2 includes an operating system driver. 

1 8. The method as claimed in claim 6 wherein the self-describing information 

2 includes a user application. 

- 18 - 



BNSDOCID: <WO 990691 OA 1 J _> 



WO 99/06910 PCTYUS98/15529 

1 9. The method as claimed in claim 8 wherein the user application provides a 

2 graphical user interface through which a user is provided access to the user application. 

1 10. The method as claimed in claim 6 wherein the address is an internet address. 

1 11. The method as claimed in claim 6 wherein the address points to a location 

2 within a network of devices which includes the first device and the second device. 

1 12. The method as claimed in claim 6 wherein the address is modifiable. 

113. A device including self-describing information comprising: 

2 a. means for storing self-describing information; 

3 b. a physical interface for allowing the device to communicate with other 

4 devices including transmitting the self-describing information; and 

5 c. a controller coupled to the means for storing and to the physical interface for 

6 controlling communication through the interface with other devices. 

1 14. The device as claimed in claim 13 wherein the self-describing information 

2 includes a graphical representation of the device. 

1 15. The device as claimed in claim 13 wherein the self-describing information 

2 includes an address from where additional information about the device is obtained. 

1 16. The device as claimed in claim 15 wherein the address is an internet address. 

1 17. The device as claimed in claim 13 wherein the self-describing information 

2 includes information regarding controls and functionality of the device. 

1 18. The device as claimed in claim 17 wherein the self-describing information is 

2 used to provide a graphical interface on a controlling device for controlling operation of 

3 the device through the controlling device. 
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1 19. The device as claimed in claim 13 wherein the means for storing self- 

2 describing information includes a memory device. 

1 20. The device as claimed in claim 19 wherein the memory device is a read-only 

2 memory. 

1 21. The device as claimed in claim 13 wherein the means for storing self- 

2 describing information includes a media device. 

1 22. The device as claimed in claim 13 wherein the means for storing self- 

2 describing information includes a broadcast receiving device. 

1 23. The device as claimed in claim 13 wherein the physical interface is an IEEE 

2 1394 interface for interfacing the device to an IEEE 1394 serial bus structure. 

1 24. A system configuration comprising: 

2 a. a plurality of devices coupled together, each of the plurality including: 

3 i. means for storing self-describing information; and 

4 ii. a physical interface for allowing the device to communicate with 

5 other devices including transmitting the self-describing information; 

6 and 

7 b. a system coupled to the plurality of devices for presenting a graphical 

8 interface, utilizing the self-describing information from each of the plurality 

9 of devices, through which operation of the plurality of devices is controlled. 
10 the system including a microprocessor and a display. 

1 25. The system configuration as claimed in claim 24 wherein the self-describing 

2 information includes a graphical representation of a respective device. 

1 26. The system configuration as claimed in claim 25 wherein the self-describing 

2 information includes information regarding controls and functionality of the respective 

3 device. 
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1 27. The system configuration as claimed in claim 26 wherein the means for 

2 storing includes a memory device. 

1 28. The system configuration as claimed in claim 27 wherein the memory device 

2 is a read-only memory. 

1 29. The system configuration as claimed in claim 28 wherein the self-describing 

2 information includes an address through which the system is able to obtain additional 

3 information about the respective device. 

1 30. The system configuration as claimed in claim 29 wherein the self-describing 

2 information includes an operating system driver. 

1 31. The system configuration as claimed in claim 30 wherein the self-describing 

2 information includes a user application. 

1 32. The system configuration as claimed in claim 31 wherein the address is an 

2 internet address. 

1 33. The system configuration as claimed in claim 31 wherein the address points 

2 to a location within one of the plurality of devices. 

1 34. The system configuration as claimed in claim 29 wherein the graphical 

2 interface includes graphical representations of the plurality of devices and connections 

3 between devices. 

1 35. The system configuration as claimed in claim 34 wherein operation of 

2 selected devices is controlled through the interface by communications from the system to 

3 the selected devices. 

1 36. The system configuration as claimed in claim 35 wherein the system and the 

2 plurality of devices are all coupled together by an IEEE 1394 bus structure. 
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1 37. A graphical user interface for controlling operation of devices coupled 

2 together into a network configuration, the graphical user interface comprising: 

3 a. a plurality of device images each representing a device within the network 

4 configuration; 

5 b. graphical representations of connections between the plurality of device 

6 images representing actual connections of the devices within the network 

7 configuration; and 

8 c. control means for displaying available controls for selected ones of the 

9 devices and controlling operation of the devices based on selected controls; 

10 wherein the plurality of device images and the available controls are obtained from self- 

1 1 describing information stored within the devices. 

1 38. The graphical user interface as claimed in claim 37 wherein the graphical 

2 user interface is displayed on a computer system having a display, a memory and an input 

3 device. 

1 39. The graphical user interface as claimed in claim 38 wherein the input device 

2 is a mouse. 

1 40. The graphical user interface as claimed in claim 37 wherein the graphical 

2 user interface is displayed on a television. 

1 41. The graphical user interface as claimed in claim 40 wherein the input device 

2 is an infrared remote control device. 

1 42. The graphical user interface as claimed in claim 37 wherein the self- 

2 . describing information includes an address through which the device image and the 

3 available controls are obtained. 

1 43. The graphical user interface as claimed in claim 42 wherein the address is an 

2 internet address. 
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1 44. The graphical user interface as claimed in claim 42 wherein the address 

2 points to a location within the network configuration. 

1 45. The graphical user interface as claimed in claim 37 wherein the self- 

2 describing information for a device includes a graphical representation of the device and 

3 information regarding controls and functionality of the device. 

1 46. A system for controlling devices coupled to a bus structure comprising: 

2 a. a bus structure configured for providing communications between devices; 

3 b. a plurality of devices coupled to the bus structure for communicating across 

4 the bus structure, each of the plurality of devices including self-describing 

5 information; and 

6 c. a graphical user interface for controlling operation of the plurality of devices 

7 including: 

8 i. a plurality of device images each representing a corresponding one of 

9 the plurality of devices and each obtained from the self-describing 

10 information of the corresponding device; and 

11 ii. a bus structure representation illustratively coupled to each of the 

12 plurality of device images representing the bus structure; 

1 3 wherein operation of the devices is controlled through the graphical user interface. 

1 47. The system as claimed in claim 46 wherein the graphical user interface is 

2 displayed on one of the devices including a microprocessor and a display. 

1 48. The system as claimed in claim 47 wherein the graphical user interface 

2 further comprises control means for displaying available controls for selected ones of the 

3 devices and controlling operation of the devices based on selected controls, wherein the 

4 available controls are obtained from the self-describing information of the corresponding 

5 device. 

1 49. The system as claimed in claim 48 wherein the bus structure is an IEEE 

2 1394 serial bus structure. 
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1 50. The system as claimed in claim 46 wherein the self-describing information 

2 for a device includes a graphical representation of the device and information regarding 

3 controls and functionality of the device. 

1 51. The system as claimed in claim 50 wherein. the self-describing information 

2 further includes an internet address through which additional information about the device 

3 is obtained. 

1 52. The system as claimed in claim 51 wherein each of the plurality of devices 

2 includes a memory for storing the self-describing information. 

1 53. The system as claimed in claim 52 wherein the memory is a read-only 

2 memory. 

1 54. The system as claimed in claim 46 wherein the self-describing information 

2 further includes an address which points to a location within the devices coupled to the bus 

3 structure through which additional information about the device is obtained. 
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